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ABSTRACT 

Objective: In patients who have undergone a 
potentially curative resection of colorectal cancer, does 
a 'second-look' operation to resect recurrence, 
prompted by monthly monitoring of carcinoembryonic 
antigen, confer a survival benefit? 
Design: A randomised controlled trial recruiting 
patients from 1982 to 1993 was recovered under the 
Restoring Invisible and Abandoned Trials (RIAT) 
initiative. 

Setting: 58 hospitals in the UK. 
Participants: From 1982 to 1993, 1447 patients were 
enrolled. Of these 216 met the criteria for 
carcinoembryonic antigen (CEA) elevation and were 
randomised to 'Aggressive' or 'Conventional' arms. 
Interventions: 'Second-look' surgery with intention to 
remove any recurrence discovered. 
Primary outcome measure: Survival. 
Results: By February 1993, 91/108 patients had died 
in the 'Aggressive arm' and 88/108 in the 
'Conventional' arm (relative risk=1.16, 95% CI 0.87 to 
1.37). By 2011 a further 25 randomised patients had 
died. Kaplan-Meier analysis showed no difference in 
long-term survival. 

Conclusions: The trial was closed in 1993 following a 
recommendation from the Data Monitoring Committee 
that it was highly unlikely that any survival advantage 
would be demonstrated for CEA prompted second-look 
surgery. This conclusion was confirmed by repeat 
analysis of survival times after 20 years. 
Trial registration number: ISRCTN76694943. 



INTRODUCTION 

The Working Party of the carcinoembryonic 
antigen (CEA) Second-Look Trial set the 
scene for their trial in their protocol in 
1982 (Slack W, Bagshawe K, Baum M, et al 
Protocol: a multicentre trial to evaluate the 
use of serial carcinoembryonic antigen assay 
as the prime indicator for second-look 



Strengths and limitations of this study 



■ The carcinoembryonic antigen (CEA) Second- 
Look Trial was a well-planned and carefully 
executed study with a clear question and a well- 
defined outcome of interest. 

■ Second-look surgery prompted by the best avail- 
able indicator of recurrence at the time conferred 
no survival advantage. 

■ A further strength, and a reason to publish this 
trial now, is that it shows that randomised trials 
in surgery can be carried out and that the result 
may be contrary to the beliefs and expectations 
of practitioners based on their uncontrolled 
observations. 

■ A limitation is that present day means of non- 
invasive detection of asymptomatic recurrence 
were not available at the time of the CEA 
Second-Look Trial. A recently reported rando- 
mised controlled trial (FACS) in which regular 
CEA and/or CT monitoring were compared with 
minimum follow-up showed no survival advan- 
tage associated with earlier detection through 
monitoring. i 



surgery in recurrent colorectal cancer (Trial 
Archive), 1982, unpublished work). The 
principal finding, that CEA monitoring to 
detect asymptomatic recurrence was not asso- 
ciated with improved survival, was 
announced in a letter to the Journal of the 
American Medical Association in 1994 by 
North over, the then chief investigator/ The 
writing of the trial for publication lapsed. We 
here report the trial under the Restoring 
Invisible and Abandoned Trials (RIAT) 
initiative.^ ^ 

It had been observed during the 1970s that 
the outlook for patients with colorectal 
cancer was not good. Only one in four 
patients survived for 5 years after diagnosis 
and radical surgery was observed to be 
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curative in under half of patients. Results had not 
improved in several decades (Slack et al, 1982, unpub- 
lished work).^ ^ Refinements in primary operative tech- 
niques had not made a difference^ and it was 
considered unlikely that technical modifications would 
lead to improvement in survival following surgery."^ ^ 
Routine surgical follow-up had not led to further 
surgery being shown to be beneficial: clinical evidence 
of recurrence usually meant that the tumour would be 
unresectable at second-look laparotomy.^ The published 
experience of members of the Working Party who devel- 
oped and launched the trial was that of 180 patients, fol- 
lowed up from 6 months to 15 years, with a total of 2319 
outpatient clinic visits, only 1 patient could be consid- 
ered to have had a potentially curative second-look oper- 
ation.^ They concluded that to re-resect with prospect of 
benefit, recurrence had to be detected before it was clin- 
ically evident (Slack et al, 1982, unpublished work) but 
more proactive clinical follow-up of asymptomatic 
patients by three monthly sigmoidoscopy, barium enema 
and chest X-ray (the methods available at the time) had 
failed to show improvement in 5-year survival. 
Nevertheless, there had been several reports of 30% 
5-year survival in selected patients after radical resection 
of recurrent cancer^ and resection was believed to 
sometimes lead to 'cure'.^ ii-i^ 
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TRIALS CENTRE 



Improving detection and treatment of recurrent disease; 
tlie context in 1982 

The trial development group considered the evidence 
available at the time for methods of detecting recur- 
rence early and a founding principle of the CEA 
Second-Look Trial was that early detection of recurrent 
tumour would only be justifiable if further treatment 
offered the prospect of benefit to the individual patient 
(figure 1; Slack et al, 1982, unpublished work). The evi- 
dence available to the trial working party in 1982 is out- 
lined below 



Tlie Wangensteen approach 

During the 1950s the systematic use of a policy-based 
second operation was reported. Patients at high risk of 
recurrence (those with Dukes' Stage C tumours) were 
reoperated on at six-monthly intervals, resecting recur- 
rence when found, until they were 'tumour free'. If cancer 
had been found the patients were scheduled for third and 
more 'looks', up to six further abdominal operations, 
'before the abdomen was free of cancer' (figure 2). Once 
a patient had undergone a negative laparotomy no more 
surgery was recommended. Sixty-four patients with colon 
or rectal cancer were managed in this way. In 35 (55%) of 
them the 'second-look' laparotomy was negative for the 
discovery of recurrent cancer, 7 of whom subsequently had 
clinical recurrence. There were four (6%) operative 
deaths. The Working Party concluded that this 'blanket 
second-look' policy might have produced some 'cures' but 
entailed high rates of negative laparotomy and an 



Cancer Research Campaign Clinical Trials Centre 

King's College Hospital Medical School 

Rayne Institute 

123 Coldharbour Lane 

London SE5 9NU 

(Direct Line) Telephone: 01-737 3642 

Figure 1 The 'Working Party' that produced the protocol in 
1982 for the carcinoembryonic antigen Second-Look Surgery 
Trial (Slack etal, 1982, unpublished work). 



unacceptable operative mortality rate (Slack et al, 1982, 
unpublished work) . 



Tlie CEA-prompted second-iool( approacli 

CEA had been shown to detect recurrence of colorectal 
cancer following surgery/ CEA rose, on average, 
4 months prior to clinical evidence of recurrence and 
there were reports of the use of serial serum CEA assays 
to detect asymptomatic recurrences in the belief that 
curative resection would be possible more frequently/ 
Several groups used CEA in this way, and found low false- 
positive rates^ and the resectability rate of recurrence 
was higher than when clinical criteria were used to 
prompt reoperation.^ In the largest published experience 
of CEA in a postoperative monitoring role^ recurrent 
tumour, which was resectable, was found in 70% in whom 
reoperation was prompted by a rise in the serum CEA 
compared with a quarter of patients undergoing second- 
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Figure 2 Illustration of operative 
findings in six successive 
operations seeking recurrence of 
colorectal cancer.'''^ 



WANGENSTEEN et al.: SECOND LOOK PROCEDURE FOR CANCER 



259 




^■^^1 V/ 
operation y 

Funj^arin^ carcinomo Positive aorTic 
of cecum lymph node 



5fh. look y ' 6Jh. looK ^ 

Posii ive reiro-duodenal 
lymph node No carcinoma 




Fig. I . Semidiagrammatic illustration of the 6 operations 
done on the patient described as Case i in the text. Malig- 
nant tissue is shown in black and the structures excised at 
each operation are drawn in dotted lines. 



3rd. look y 4th. look ' 

Posirive lymph node, Two posifiv^ aortic 
j^ranuloma lymph nodes 



look laparotomy prompted by clinical indications. Others 
had not found CEA to be useful in this postoperative 
monitoring role. Even if efficacy of CEA-detected recur- 
rence was accepted, there was still the unresolved ques- 
tion of effectiveness: if more patients were detected and 
there were more instances of resectable recurrence, did 
that lead to better survival and patient benefit? The con- 
flicting interpretations of observational data resulted in 
calls for trials 21 22 ind^fjing one within a 1981 NIH 
Consensus Statement.^^ 

The objective of the CEA Second-Look Surgery Trial 
was to determine whether, following potentially curative 
primary surgery for colorectal cancer, mortality could be 
decreased by a policy of second-look surgery prompted 
by rising serum CEA. The trial ran from 1982 to 1993. 
The main result, that there was no survival advantage, 
was reported in 1994 to the British Oncological 
Association^^ and was published in a letter to the Journal 
of the American Medical Association} 

Detection and reoperation for asymptomatic colorec- 
tal cancer recurrence has since become routine in the 
form of hepatic resection^^ and pulmonary metastasect- 
omy^^ but without evidence from controlled trials for 
either practice. When doubts were raised about the 
security of the evidence in the BMJ in 2007^^ a general 
belief existed that randomised controlled trials of the 
effectiveness of resection of liver or lung metastases were 
not possible and were not needed. These paired beliefs 
are brought into question by the previously unpublished 
CEA Second-Look Trial: a randomised trial had been 
carried out and the presumed benefit of surgery for 

1 23 

cancer recurrence was not seen. 



Closure of the trial in 1993 and gaining access to the data 
in 2011 

The RIAT restorative authors had been involved in various 
studies related to surgery for disseminated colorectal 
cancer including a conundrum as to whether discov- 

ery of an elevated CEA assay should prompt, or be consid- 
ered a contraindication to, pulmonary metastasectomy.^^ 
We knew the CEA trial had been recruiting in the 1980s 
but when we searched the literature for the result of the 
trial we found nothing later than 1994.^ In 2009 we con- 
tacted the chief investigator of the trial at the time of its 
closure ( JMAN) and the present director of the University 
College London Cancer Trials Centre (JAL). We were 
informed that the data were irretrievably lost. However, 
KM was aware that CEA trial data were still in the depart- 
ment and after further enquiries RCGR gained access to 
anonymised electronic data in 2011. The process of data 
restoration is described later. It was agreed that the trial 
would be published as part of 'RIAT'.^ ^ 

Among the documents made available to the RIAT 
restorative authors were listed the members of the trial 
development group in the 1982 protocol (Slack et al, 
1982, unpublished work) and the contributors to the 
1994 manuscript (Northover J, Houghton J. Post opera- 
tive CEA monitoring and second-look surgery in colorec- 
tal cancer: the effect on survival measured using a 
multicentre randomised trial (Manuscript), 6-7-1994, 
unpublished work) . None of these individuals expressed 
an interest in resuming work on the trial or were in a pos- 
ition to do so. When we contacted them later to share the 
restored data with them no one raised any objection but 
on the contrary encouraged us to publish their findings. 
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METHODS 

Trial intent and design 

The recruitment intentions and the trial protocol as pre- 
sented here are essentially as written in the manuscript 
prepared in 1994 with the full intention of publishing 
the trial (Northover and Houghton, 1994, unpublished 
work) . The text has been edited by the RIAT authors but 
no new material has been introduced. 

The CEA Second-Look Trial was intended to recruit at 
least 2000 patients over 3 years and to follow them for 
5 years. The study was specifically designed with late ran- 
domisation in order to maximise statistical power. It was 
originally intended to recruit 2000 patients with the 
anticipation that about 25% would show a CEA rise as 
the first evidence of possible recurrence. This number 
would have provided 95% power to detect an improve- 
ment in 2-year survival from the second-look procedure 
from 25% to 55% at a=0.05. The protocol stated that for 
the trial to be stopped prematurely very stringent levels 
of significance (p<0.001) would be used. Analyses of the 
randomised groups were to be by Kaplan-Meier lifetables 
and the logrank test on 'intention to treat' (Northover 
and Houghton, 1994, unpublished work). 

Their intentions were explicitly set out as follows in 
1981 (Slack WW, Public Health Service Grant 
Application to NIH, 1981, personal communication): 

So far as society in general is concerned, if CEA monitoring 
is shown to be of benefit in this study, then it will be a 
powerful incentive to the great majority of surgeons who 
see no obvious advantage in routine CEA monitoring to 
adopt the technique; as colorectal cancer is the second 
commonest killing cancer in the Western world, the bene- 
fits would thus be enormous. If, however, CEA monitoring 
is shown to be of no long term therapeutic value then it 
should cease to be used in its presently available form, and 
patients will thereby be spared the 'needless anxiety'^^ of 
premature knowledge of their impending death. 

The CEA trial design (figure 3) was devised so that 
clinical follow-up would remain unbiased, and allow spe- 
cific evaluation of the role of CEA-indicated surgery in 
the treatment of recurrent colorectal cancer. After 
potentially curative surgery for colorectal cancer, all eli- 
gible patients were to be monitored identically using 
conventional clinical follow-up together with regular 
CEA assay, performed centrally. Clinicians would not be 
informed of the result. When a 'significant' CEA rise was 
recorded, patients were to be randomised by the Trials 
Centre into either 'Aggressive' or 'Conventional' arms. 
In the case of patients in the 'Aggressive' arm, the clin- 
ician would immediately be informed of the CEA rise so 
that the patient could be urgently screened to exclude 
widespread metastatic disease or a non-malignant cause 
for the CEA rise. If neither was found, and the patient 
was medically fit for operation, the protocol required 
second-look surgery to locate and remove any treatable 
recurrence. In the case of patients in the 'Conventional' 
arm, the clinician would not be informed of the 



'significant' CEA rise nor of the fact that they had been 
randomised to not have the CEA rise revealed. 

The primary outcome was survival based on death cer- 
tification through the Office of Population Censuses and 
Surveys (OPCS; now called the Office for National 
Statistics (ONS)). No subset analyses were planned. 

The intention as stated in tlie protocol was tliat the trial 
would produce 

A. A definitive answer concerning the effectiveness of 
CEA-prompted second-look surgery to improve 
survival. 

B. An accurate picture of the 'lead time' produced by 
CEA compared to clinically indicated second-look 
surgery. 

C. Further data relating CEA levels to tumour histology 
and topography. 

D. A large database on the natural history of colorectal 
cancer (Slack et al, 1982, unpublished work). 

The RIAT restorative authors regard (A) and (B) as 
planned analyses. The (C) and (D) statements give no 
indication as to the precise nature of analyses that might 
follow and are regarded as opportunities for explanatory 
subset analyses which were not in the event carried out. 

The conduct of the trial 1982-1993 

The trial was coordinated (initially) from the Cancer 
Research Campaign (CRC) Clinical Trials Centre at 
King's College Hospital. CEA assays were performed 
using a radioimmunoassay technique at a single centre 
at Charing Cross Hospital. 

Selection of patients 

All patients up to the age of 76 who had undergone a 
potentially curative resection for adenocarcinoma of the 
colon or rectum and who were fit and willing to adhere 
to the postoperative monitoring routine were eligible for 
the study. Patients were excluded if there was evidence 
of incurable distant spread, either preoperatively or 
during the primary operation, or if the CEA level failed 
to return to the normal range (<10ng/mL) within 
6 weeks of primary surgery. Patients who had previously 
received treatment for other types of cancer, apart from 
basal or squamous cell carcinoma of the skin or in situ 
carcinoma of the cervix adequately cone biopsied, were 
excluded from the study. 

Management of the primary tumour 

A preoperative blood sample for CEA assay was taken 
from all patients with suspected colorectal adenocarcin- 
oma who otherwise fulfilled the trial entry criteria. This 
was a pragmatically designed study so surgeons were at 
liberty to use their normal operative technique and to 
employ preoperative or postoperative radiotherapy or 
adjuvant chemotherapy as was seen fit, however they 
were asked to remain consistent regarding the treatment 
used for any particular type of disease. If at laparotomy, 
a potentially curative resection was performed and 
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subsequent histology confirmed the diagnosis of adeno- 
carcinoma, the patient was given a full explanation of 
the study and could be registered. 

Consent 

The 1982 protocol includes a consent form (Consent 
form A) to be completed at registration and a further 
form (Consent form B) for patients who were rando- 
mised to a 'Second-Look Laparotomy'. There was a 
protocol amendment in which the word 'cancer' is to be 
replaced throughout by 'a growth' (Slack et al, 1982, 
unpublished work) . 

Baseline data 

The surgeons carried out investigations to detect the 
presence of synchronous colorectal tumours (benign 
and malignant) and to exclude occult liver spread; 
(usually barium enema examination and ultrasound or 
CT of the liver). In addition, factors that could give 
raised CEA levels in the absence of recurrent colorectal 
cancer, such as chronic lung disease, cirrhosis, chronic 
pancreatitis and chronic renal failure were excluded by 
clinical questioning, chest X-ray, liver function tests, 
blood urea and electrolytes. Smoking habits and alcohol 
consumption were also recorded as heavy smoking or 
drinking, or a change in these habits, can influence 
CEA levels. 



Monitoring of patients 

Clinical follow-up of all patients continued in an identi- 
cal manner (3 monthly for the first 2 years and 
6 monthly for the next 3 years) while blood for CEA 
assay was drawn monthly for the first 3 years and 
3 monthly for the next 2 years. If the patient remained 
well and the CEA was within normal limits as defined by 
a pretested algorithm, monitoring continued according 
to the schedule. 

CEA assay 

Ten millilitres of whole blood were taken from each 
patient. The serum was separated and sent to the Trials 
Centre in special plastic phials. After logging receipt, the 
samples were forwarded to the Medical Oncology 
Department at Charing Cross Hospital for assay. The 
results were returned to the Trials Centre for recording 
and action if appropriate. This centralised system 
ensured that all participating clinicians were kept blind 
to the CEA results for their patients. It also ensured 
quality control of the CEA assay as there was no possibil- 
ity of interlaboratory variation. 

Serum CEA values were measured by double antibody 
radioimmunoassay.^^"^^ A bank of serum samples has 
been retained at -20°C. 

IVIonitoring assay compliance prerandomisation 

Throughout the trial, compliance with blood sampling 
was monitored by the secretariat. Clinicians were 



reminded each month of the patients for whom samples 
were due; those who had missed the previous visit were 
highlighted as urgent. The percentage compliance for 
each participating patient was calculated as the number 
of samples received divided by those expected xlOO. The 
median time between samples was also calculated. 
Failure to achieve 50% of the expected samples was 
defined as poor compliance. Since the sensitivity to 
detect CEA rise in such patients was greatly reduced 
they were excluded from randomisation. 

'Significant' rises in CEA 

A rise in CEA was defined as 'significant' when the CEA 
level was greater than 10 ng/mL on two successive occa- 
sions and one of the following conditions was also met: 
the CEA level was greater than 20 ng/ mL on each of 
two successive occasions or the level was rising and the 
highest value was more than 7 ng/mL above the lowest 
value ever recorded. If a 'significant' rise in CEA 
occurred, the record of the patient was reviewed at the 
Trials Centre and provided no evidence of suspected 
colorectal or other disease was recorded in the CRF, the 
patient was randomised either into an 'Aggressive' or 
'Conventional' arm (figure 4). 

Randomisation 

Patients were randomised equally between the two arms 
(1:1). Patients whose compliance was between 50% and 
70% or whose immediate postoperative sample had not 
been received within the 4-6-week guideline were rando- 
mised in a separate stratum. Randomisation was also 
stratified by participating clinician. A block size of two 
was used in order to maintain as close a balance as pos- 
sible between the two treatment arms. 

If the patient was randomised to the 'Aggressive' arm 
the clinician was informed of the rise immediately by 
telephone from the trial centre and subsequently in 
writing and was requested to contact the patient 
urgently. Patients were informed of their situation 
including the fact that they had been randomised within 
the trial to undergo a second-look procedure. This was 
then undertaken if the patient gave written informed 
consent. The surgeon carried out a full clinical workup 
to exclude the possibility of a non-malignant cause for 
the CEA rise (eg, change in smoking or drinking habit) 
and to identify any incurable distant spread. In the 
absence of these conditions the surgeon undertook a 
mini-laparotomy, proceeding to full laparotomy with 
macroscopic clearance of disease, should this be 
possible. 

For patients randomised to the 'Conventional' arm no 
further action was taken; the clinician was neither 
informed that the CEA had risen nor that the patient 
had been randomised. 

If at any stage a patient in the study developed clinical 
evidence of recurrent disease the clinician was at liberty 
to manage the patient according to usual practice. If the 
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Suspected colorectal carcinoma 



Pre-operative Ct'A assay 



Laparotomy: confirm 'curability' 
Radical resection with tumour ablation 
Histological confirmation of diagnosis 



PROCEDURE FOR CLINICIAN 



PROCEDURE FOR TRIALS CENTRE 



Follow-up regimen 

Clinical: 

years 1-2 3 monthly 
years 3-5 6 monthly 

Blood taken for CEA assay: 
years 1-3 monthly 
years 4-5 3 monthly 



Fol iow-up 
data 



Blood 
samples 



1 


r 


1 


r 


Patient develops 
clinical evidence 
of recurrence 


Patient remains 
well 




r 




f 


Treat as indicated 
+ 2nd look 
± resection 


No action unless 
TC infoms of 
CEA rise 



Clinical 


work -up 







2nd look unless 
'vidence of distant 
spread t radical 
resection 



Register with Trials Centre 




•CEA Aggressive' 
arm 

Clinician informed 



'Conventional 'arm 
Clinician not 
informed 



Continue 
Data monitoring 



Figure 3 Flow diagram of the Second-Look Surgery Trial from the 1982 protocol (Slack ef a/, 1982, unpublished work). 



disease was in the abdomen and was thought to be treat- 
able by a second-look operation with re-resection, this 
was acceptable. By the nature of the trial design, the 
clinician was blind as to whether such patients had been 
randomised to the 'Conventional' arm of the trial or 
had not been randomised because the CEA had failed 
to denote the presence of recurrent disease. 



Second-look laparotomy 

The surgeon was expected to perform a thorough inspec- 
tion of the abdominal cavity to locate any recurrent disease. 
Initially a mini-laparotomy was performed; if widespread 
tumour was detected all that was required prior to closure, 
was biopsy. Otherwise following a full excision, bimanual 
palpation of the old scar, inspection and palpation of the 
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CEA < iOng/ml 4-6 weeks 
after surgery?* 




Yef^ 

r 


Regular CEA assay as per 
Protocol. A value >10ng/ml 
will be noted and next 
monthly sample assayed 
urgently 




f 


CEA stil 1 > lOng/ml? 




Yes 

f 



No 



Suggests incomplete resection 
Repeat assay in one month 
CEA still >10ng/ml? 



CEA >20ng/ml on both 
estimations? 



CEA rising, and highest 
value .'7ng/ral above 
lowest value ever 
previously recorded? 



No 



Yes 



Withdraw patient 
from study 



Monthly assays for minimum 
of three months 



No 



Repeat assay next month 



Yes 





Yes 


•SIGNIFI 
RI 


CANT' CEA 

SE 



CEA >lOng/ml on 2 
consecutive occasions? 



No 



'CEA Aggressive' 
dm 



Clinician informed 
(see p. 10> 



Conventional ' 
arm 





No action 
Cl inici.jf» r^.ut 
informed 
(see p. lO) 



* 10 ng/ml is the upper limit of normal for serum 
CEA as measured at the Department of Medical 
Oncology, Charing Cross Hospital 

This flow chart will be used to decide upon the action to be taken on 
the basis of CEA results. 

Figure 4 Decision-making algorithm for CEA to trigger second-look surgery.^"^ 



pelvic cavity, the small bowel, the mesentery, the retroperito- 
neum, the colon and rectum and the anastomosis was 
undertaken. The liver was fully mobilised to determine 
whether any tumour was present. Detailed dissection of the 
pelvic and retroperitoneal areas and therapeutic resection 
were then carried out with the objective of total extirpation 
of all recurrence. Complete data recording of the proced- 
ure along with the results of the histology of all potentially 
involved sites was required by the trial's office. 



For patients in whom a radical resection was achieved 
after second-look surgery (motivated either on clinical 
information or because the patient had been rando- 
mised to the 'Aggressive' arm) the follow-up schedules 
for clinical examination and blood sampling reverted to 
those following the primary operation. However, for 
patients randomised to the 'Aggressive' arm, clinicians 
were immediately notified of any further CEA levels 
above 10 ng/mL. 
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Death 

Every patient registered onto the study was 'flagged' 
with the OPCS (now ONS) which provides automatic 
notification of date of death. This enabled the trial 
centre to receive certified cause of death for all patients. 

Trial oversight 

A Data Monitoring Sub-Committee (DMSC) composed 
of Working Party members not entering patients into 
the trial was asked to review the data after the first 100 
patients had been randomised, which occurred in 
January 1988, and again after 200 patients had been ran- 
domised in February 1993. At this point it was recom- 
mended by the Data Monitoring Committee that the 
trial be stopped since it was very unlikely that any clinic- 
ally important advantage would be demonstrated for 
patients undergoing second-look surgery. 

IVIethods of the RIAT process 

Data 

The RIAT restorative authors had been warned by the 
statisticians called in to look at the data in 2003-2004 
that 'the databases were corrupted with key variables no 
longer abstractable' (McConkey C. Chris McConkey 
e-mail 1 October 2009, unpublished work and Gray 
R. Richard Gray e-mail 1 October 2009, unpublished 
work). We found that the data on paper and on file 
were accessible and we had no reason to doubt the ver- 
acity of individual items. We found that the electronic 
files had numerous problems with formatting which 
made the files on the 1447 individual patients difficult 
to handle but that the data entries were not themselves 
corrupted. 

One of the RIAT restorative authors (KM) had worked 
in the Trials Centre during the time the CEA trial data 
were being accrued and knew the systems in use and 
their changes but was not directly involved in this trial at 
any stage. 

The questions raised and the problems encountered 
were resolved as follows: 

► The codes indicating that a patient had met the cri- 
teria for CEA elevation and whether they were rando- 
mised to 'Aggressive' or 'Conventional' arm were 
preserved and tallied with the number in the 1994 
manuscript (North over and Houghton, 1994, unpub- 
lished work) . 

► There were variations in the way dates were recorded 
in the database. There had been migrations of data 
from a 'Prime' server using 'Universe' to 'Excel' and 
the interpretation of the present authors, with infor- 
mation from contemporary witnesses was that in 
undertaking the task operators did not always cor- 
rectly specify these data as 'dates' when importing, 
and/or allowed them to be converted to American 
date formats. These errors prevented calculations and 
would have defeated running a survival analysis 
without correction of the file entries. The dates were 
however visually readable and not 'corrupt'. Some 



could be corrected by running current versions of 
software. Others were manually corrected by 
re-entering them in a Microsoft date format. Paper 
records were available to resolve uncertainties. 

► The next problem was in linking these three groups 
of patients (randomised to 'Aggressive', randomised 
to 'Conventional' and not randomised) to the dates 
for survival analysis. Individual patients were uniquely 
identified in the files by seven digit strings to which 
letters had been added at the beginning and end, 
possibly for trial administrators' checklists or sub- 
group identification. Once we had established that 
the initial and terminal letters were redundant for 
analysis of the primary endpoint, we were able to 
write the code to restore the seven digit strings. 

► It was evident that the seven digits did not represent 
a simple sequence but certain positions identified 
particular characteristics, such as participating centre. 
We recognised a consistent pattern of mismatch in 
the fourth digit, a zero in one file was an eight in the 
other with all other digits remaining the same. It was 
suggested to us that the fourth digit replacement was 
used to identify patients suitable for post hoc sub- 
group analyses but no documentation was found to 
confirm this. By checking back to the dates of birth 
we were able to confirm that this systematic correc- 
tion resolved the problem and most of the data were 
then usable. 

► By ranking all the data in the paired files for line by 
line visual inspection residual discrepancies were 
identified. Scrutinising the digit strings allowed for 
seven of the remaining eight pairs to be reconciled 
and verified on dates of birth. We failed to resolve 
only 1 of 1447 records in each file. This patient had 
not been randomised. 

► Inspection of the accrual of death dates was discon- 
tinuous for a couple of years suggesting a lapse in 
either recovery or entry. The current trials centre 
obtained permission to re-run the ONS search in July 
2012. 

In summary, we identified several problems but they 
were systematic and not random (we would not use the 
value-laden word 'corrupted'). We were able to rectify 
the formatting errors and verify that the data used for 
our analysis were correct. The Kaplan-Meier analysis was 
re-run. 



RESULTS 

The original main results 1994 

The study opened to recruitment in November 1982 
and was closed by the Working Party, on the acceptance 
of a recommendation from the DMSC, on 17 February 
1993. During this period 1447 patients were registered 
by 73 participating clinicians in 58 hospitals in the UK. 
Of these 39 (2.7%) were deemed ineligible since their 
CEA did not fall below lOng/mL by 6 weeks after 
surgery. A further 173 patients were excluded from 
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analysis; 4 did not have a confirmed diagnosis of adeno- 
carcinoma, 6 were considered unfit for continued moni- 
toring, 4 had a previous and 1 a simultaneous 
non-colorectal malignancy, 2 had metastatic disease and 
156 (10.8%) never complied with the requirement for 
monthly blood sampling or only did so for 3 months or 
less (figure 5). 

Of 1235 patients who continued in the trial, 80% 
achieved a greater than 60% compliance with blood 
sampling, while 12.5% registered between 40% and 59% 
of the required samples and only 7.5% had compliance 
of less than 40% The majority of randomisations (160/ 
216; 74%) were prior to the second anniversary of the 
primary diagnosis. Three patients randomised had prior 
recurrent^ or metachronous (Slack et al, 1982, unpub- 
lished work) disease detected clinically, without a rise in 
CEA and were operated on. 

Two hundred and sixteen patients developed a 'signifi- 
cant' rise in CEA and as no recurrent disease had been 
recorded at their latest trial follow-up, they were rando- 
mised by the Trial Office (108 to each arm). The 
median time from primary surgery to randomisation was 
403 days, (range 103-1754) with no statistical difference 
between the two groups (Northover and Houghton, 
1994, unpublished work). 

The characteristics of patients in the two groups are 
given in table 1. 

The stage mix of 980 patients who were eligible for 
inclusion in the randomised trial but who did not have a 
CEA rise as defined was Dukes' A 15.1%, B 55.2%, CI 
23.3%, C2 6.4%. 

Of the patients randomised to the 'Aggressive' arm 83 
(77%) had recurrent cancer identified and 62 (57%) 
patients had 'second-look' surgery. In patients rando- 
mised to the 'Conventional' arm 89 (82%) had 



developed recurrent disease by the date of analysis. In 
26 (24%) of these patients second-look procedures 
were undertaken. By February 1993, 91/108 in the the 
'Aggressive arm' had died and 88/108 patients had died 
in the 'Conventional' arm (relative risk=1.16, 95% CI 
0.87 to 1.37) (Northover and Houghton, 1994, unpub- 
lished work). It was considered by the data monitoring 
committee to be 'highly unlikely that any survival advan- 
tage would be demonstrated for patients undergoing 
second-look surgery'. This was communicated to the 
chief investigator. 

RIAT restoration and updated survival analysis 

The data were restored by the RIAT authors for 1446 of 
1447 patients to the extent that the RIAT authors were 
confident of their dates of birth, death and whether 
they met criteria for entry into the controlled trial and 
then to which arm they were allocated. 

The electronic records were intact with respect to the 
identity of the patients, which patients had reached the 
criteria for randomisation, and the trial arm to which 
they had been randomly allocated for all 216 patients 
who were randomised. The sex, age, primary site and 
Dukes' stage as recorded in the 1994 manuscript are 
shown in table 1. 

Certification of death was obtained from ONS on 
behalf of the RIAT restorative authors for 204 of 216 ran- 
domised patients who died between 17 October 1983 
and 8 September 2011. There were equal numbers of 
patients in the two arms (108) and equal numbers of 
death dates were retrieved (102). We also have dates of 
death in 862 of the 1230 patients who were not rando- 
mised. Kaplan-Meier analysis in these three groups is 
shown in figure 6, showing survival of the 1230 



Figure 5 Flow chart of enrolled 
and ultimately randomised 
patients. 'Blind' in the bottom left 
box means that the clinical teams 
were unaware of the elevated 
carcinoembryonic antigen 
discovered and were unaware 
that the patients have been 
randomised. They were 
indistinguishable among the 1230 
non-randomised patients who 
were being followed up (see 
figure 6). 



Eligible patients 
1447 



1235 continued 



216 met CEA criteria 
Randomised 



108 'conventionaT 



108 'aggressive' 



39 Ineligible 

CEA did not fall below 10 ng/ml 
by 6 weeks after surgery 



173 other exclusions 

4 no confirmed adenocarcinoma 
6 unfit for continued monitoring 

5 non-colorectal malignancies 
2 metastatic disease 

156 did not comply with CEA monitoring 



26 had a laparotomy 


105 investigated 


But they were 


73 considered for second-look surgery 


not distinguishable 


11 not operated 


amongst the total trial 


60 laparotomy 


cohort by clinical sites 


2 thoracotomy 



Treasure T, Monson K, Fiorentino F, etal. S/WJ Open 201 4;4:e004385. doi:1 0.1 136/bmjopen-201 3-004385 



9 



Open Access 



Table 1 Age, sex and colorectal cancer stage of 216 
randomised patients 







OUI 1 VCl lllvJI ICII 




IN— 1 uo 


IN— 1 uo 


Sex male (%) 


60 (56%) 


68 (63%) 


Age years, median 


64 (33-75) 


62 (35-75) 


and range 






Pathological stage 


N (%) 


N (%) M 


Dukes' A 


5 (4.6) 


5 (4.6) ■ 


Dukes' B 


46 (42.6) 


49 (45.4) ■ 


Dukes' C1 


36 (33.3) 


38 (35.2) ■ 


Dukes' C2 


17 (15.7) 


10(9.3) • 


Missing 


4 (3.7) 


6 (5.6) 



participants who entered the trial but were not rando- 
mised and the 108 participants randomised into each 
arm. 

The lead time conferred by CEA monitoring, defined 
as the median time to clinically detected disease for 
patients randomised to the 'Conventional' arm, was 
323 days (95% CI 203 to 443). This analysis included 
censored observations on 23 patients, however only 5 of 
these had a censored time less than the lead time. It was 
regarded as unlikely, therefore, that the lead time would 
decrease as further events occur. The analysis presented 
to the British Oncological Association in 1994 showed 
that at 3, 6 and 12 months the CEA versus clinical detec- 
tion rates for recurrence were 88% vs 18%, 95% vs 44% 
and 97% vs 70%. The RIAT authors did not repeat this 
analysis. 

DISCUSSION 

We have restored data sufficient to achieve the primary 
outcome of interest as specified by the CEA trialists: 

Does a policy of CEA-prompted second-look surgery fol- 
lowing 'curative' resection of colorectal cancer produce a 
decrease in morbidity and mortality due to tumour recur- 
rence, despite sequelae of second look surgery? 

The answer is that acting on CEA elevation by second- 
look surgery did not reduce mortality compared with 
patients in whom similar CEA elevation remained 
unknown. This negative finding led to the closing of the 
trial in 1994^ and we confirm it here. There was a 
small non-significant excess of deaths in the 'Aggressive' 
arm. The burden of morbidity attributable to the 
greater number of investigations and operations was not 
captured by the trial protocol nor indeed the 'needless 
anxiety' which concerned Moertel et af^ and the 
authors of the CEA trial protocol (Slack et al, 1982, 
unpublished work) . 

The second planned analysis was to obtain an accurate 
picture of the 'lead time' produced by CEA compared 
to clinical pick up of patients with recurrence. CEA 
monitoring did pick up patients considerably sooner 




0 5 10 15 20 25 

time to death (years) 



Figure 6 Survival from date of recruitment into the 
carcinoembryonic antigen (CEA) Second-Look Trial (N=1446) 
following potentially curative colorectal cancer surgery. 
Patients who had CEA elevation according to the trial criteria 
(N=216) were randomly allocated in equal groups to have 
CEA revealed to their surgeons (red) or concealed (blue). 
Date of death was confirmed from Office for National Statistics 
in 104/108 in each arm. The green line is for all other patients. 
Some (N=862 of 1230) would have had clinically evident early 
recurrence precluding randomisation. The initial plateau is an 
illustration of a death-free interval"^"^ or 'immortal time bias'"^^ 
Patients in prospective studies may have a built in obligatory 
survival time from some starting point in order to attain the 
requirements to be included in the data set. This is an artefact 
but may be absorbed into survival time adding to and not 
readily distinguished from survival time attributed to treatment. 



than the clinical methods available at the time by 
11 months (95% CI 7 to 14 months). 

CEA monitoring for the purpose of early detection of 
asymptomatic cancer is currently recommended at least 
every 6 months in the first 3 years. In addition a 
minimum of two CT scans are recommended in the first 
3 years. The FACS trial, recently reported, has also 
shown no survival advantage from CEA monitoring com- 
pared with minimum follow-up. More operations were 
performed with 'curative intent' for recurrent cancer in 
those having more intensive monitoring and there were 
more deaths (18.2% (164/901) vs 15.9% (48/301); dif- 
ference, 2.3%; 95% CI -2.6% to 7.1%). These results 
are similar to the findings in the CEA trial. Although 
the phrase 'curative intent' occurs about 40 times in the 
manuscript, better survival was not achieved with any of 
the three monitoring schedules compared with 
minimum follow-up. 

The third and fourth intentions set out by the CEA tri- 
alists were (C) to obtain further data relating CEA levels 
to tumour histology and topography and (D) a large 
database on the natural history of colorectal cancer. 
Multiple CEA assay results exist in the data we hold for 
1446 patients and it would be possible to link these to 
survival as a result of the RIAT restorative work. 

With respect to the natural history of colorectal cancer 
although we trust the death certification data for the 
date of death it has been shown that 'at least a third of 
all death certificates are likely to be incorrect'. No 
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doubt aware of this and seeking much more detailed 
information, the CEA trialists had asked for detailed 
postmortem examinations. 

It appears that it was disagreement concerning 
explanatory analyses which contributed to the failure to 
publish the primary outcome of interest (Northover and 
Houghton, 1994, unpublished work). The purpose of 
such analyses would be to discover subsets of patients in 
whom there was a benefit from the intervention under 
evaluation and to thus determine the characteristics of 
patients in whom the intervention might have had a 
beneficial effect by analysis of mediators and modera- 
tors.^^ There is a general objection to this exercise 
because it can lead to spurious associations.^^ 
Furthermore when there is no overall benefit found, as 
in the CEA Second-Look Trial, any subgroup (s) where 
there is a positive association between intervention and 
outcome must be balanced by one or more other 
groups where there was net harm. The methods section 
of the 1994 manuscript states 'Subgroup analyses have 
been performed to address specific issues but these 
need to be interpreted with appropriate caution' 
(Northover and Houghton, 1994, unpublished work). In 
the event no completed subset analyses were in the 1994 
paper and the closing notes between the authors are on 
the matter of a subset analysis. We have not attempted 
any in restoring the trial. 

The answer to the primary research question was clear 
in 1993 and was the explicit reason for stopping the 
trial: it was improbable that a benefit from CEA 
prompted second-look surgery had been missed and in 
the absence of benefit there was net harm being done 
to the patients. The forms of second-look surgery now 
widely practiced in colorectal cancer are liver and lung 
resection of metastases. 

► Full mobilisation of the liver at second-look laparot- 
omy was included in the CEA trial protocol. Hepatic 
resection has entered routine practice based on 
observational data"^^ and an opportunity to do a ran- 
domised trial, for which a power calculation was pro- 
posed in 1992 from the Mayo Clinic,^^ was not 
taken.^"^ 

► Two patients had a thoracotomy prompted by CEA 
elevation. Pulmonary metastasectomy for colorectal 
cancer is, after primary lung cancer, the second com- 
monest thoracic cancer operation and is the subject 
of an ongoing randomised controlled trial. 

The CEA trial findings have been corroborated by the 
larger FACS trial. If the CEA trial results had been made 
available in 1994, and there is no evident reason why 
they should not have been, a more critical scrutiny of 
the evidence base that was used to bring liver and lung 
metastasectomy into practice^^ might have been 
undertaken. The CEA trial was a well-conceived and 
meticulously executed randomised trial and we hope 
that publishing it now more than 20 years after its com- 
pletion will indicate the possibility of more randomised 
trials in surge ry.^^ 
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